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CROSS-REFERENCE TO RELATED APPLICATIONS 



5§ The present application claims priority from Provisional U.S. 

=P Patent Application Serial No. 60/119,021, filed on February 8, 1999 
V& 

and incorporated herein by reference in its entirety. 

i 



lS| FIELD OF THE INVENTION 

% The present invention relates to user interface systems, 

methods, and computer program products, and more particularly to 
user interface systems, methods, and computer program products for 

15 multi-function consumer entertainment appliances such as for 
example a TV set-top box appliance. Such a TV set-top box 
appliance may incorporate a number of computer and entertainment 
features, including but not limited to, DVD player, internet radio 
player, e-mail access, internet web access, TV tuning, radio 

20 tuning, computer game playing, and the like. 
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BACKGROUND OF THE INVENTION 

Graphic user interface (GUIs) known in the computer art and 
have even been applied to some consumer devices. Applying common 
GUIs directly to consumer entertainment appliances may, however, be 
disadvantageous, because the typical GUI is complex and may limit 
functionality of the appliance. In particular, consumer 

entertainment appliances using remote controls may be 
technologically challenged, because of the functional limitations 
of the typical GUI and the remote control which the user employs 
for selecting and modifying particular application programs and 
games . 

For example, a Windows™ interface (Microsoft Corporation, 
Redmond Washington) is typically designed to work in a monitor type 
environment, with the user sitting less than 2 to 3 feet from the 
monitor. Such an application runs at a fairly high resolution, 
using small fonts and would be difficult to adapt to lower 
resolution monitors such as NTSC television. Even if applied to a 
large, high resolution monitor, (e.g., HDTV or the like), such an 
application may be difficult to use in a television viewing 
environment where the user sits typically 10-2 0 feet away from the 
screen. 
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Moreover, in such an environment, the use of a mouse or 
keyboard may be awkward, clumsy, and inconvenient as a typical desk 
or flat surface may not be readily available in a living room 
environment. Using a keyboard or mouse on a coffee table is 
awkward and ergonomically incorrect. A typical television type 
remote control would be preferable for use in a television type 
environment (e.g., living room, bedroom, home theater, or the 
like) . 

It may be desirable, therefor, to maximize application 
functionalities for different modes and applications which a. user 
may launch and switchably alternate in background and foreground 
during operation. For example, different applications or modes may 
have different video output requirements. When in the Windows 
environment, a user may <ALT TAB> between different applications. 
In such an environment, the same video output mode may be utilized 
without regard to whether the particular application would be 
optimized with a different video mode. Little regard is given to 
optimizing ancillary functionalities native to a particular 
application. Switching between applications is accomplished, but 
subject to the current functional modality without any attempt at 
functional optimization incident to the particular application. 
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In addition, it is not known in the Prior Art to check for 
resource conflicts in advance between a new application to be 
launched and applications which have already been launched. 
Moreover, resource conflicts between multiple applications are not 
known to be resolved automatically with launching of a conflicting 
application. Nor is it believed to be known in the art to switch 
between applications by simple actuation to produce a menu of 
applications followed by selection of a particular one of the 
applications from the menu. 

Similarly, it is not believed to be known in the art to 
respond automatically to a physical condition subject to active 
menu production and application selection with the launching of a 
second application if it is not already active in the background 
while being engaged with a first application, accompanied by 
switching from the first to the second application automatically, 
accompanied by an environmental context change associated with the 
second application. 

For example, in a Windows™ environment, the possible conflicts 
between various programs and between various hardware types are 
almost endless, due to the constantly increasing number of software* 
programs and hardware devices available for use in a computer 
system. If a user attempts to launch an application or use a 
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hardware device which causes a conflict with another application or 
hardware device, the end result may be an error message, such as a 
general protection fault. For a typical consumer, such error 
messages are confusing and frustrating. Moreover, when such errors 
occur, oftentimes, data may be lost, the system may lock up, or an 
application must be closed manually. 

A typical consumer is more familiar with a standard television 
(TV) interface than with computer systems and their interfaces. 
The typical consumer is familiar with remote controls for selecting 
TV channel and changing the audio volume of the TV and controlling 
other TV parameters, as well as using such controls for VCRs, DVD 
players, cable set -top boxes, stereo equipment, and the like. 

Moreover, systems utilizing television interfaces to access 
the internet are known in the art. An example of such a system is 
the WebTV™ box which is licensed sold under a variety of brand 
names. Using a fairly simple user interface, the WebTV box allows 
a user to send and receive e-mail as well as access internet web 
sites. However, further applications of the WebTV box are fairly 
limited. 

Set-top boxes are increasingly being configured with 
adaptations of Windows operating systems, (e.g., Windows CE) . 
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However, an unsophisticated TV viewer confronted with such a 
Windows interface may find it not very consumer-oriented, user- 
friendly, or operationally intuitive. The typical consumer user 
may prefer a simple, friendly presentation of set-top choices and 
parameters, not an entire panoply of Windows operating system 
interface complexities. 

Further, if a set-top box is connected to selected information 
sources and appliances such as a telephone, a game device, the 
world wide web, TV, digital video disk (DVD) equipment, then it is 
desirable to provide the consumer user with a simple, 
particularized user interface scheme directed to all or selected 
ones of the connections, sources, and modes coupled into the set- 
top box, without the distraction of a generalized, unspecific and 
unduly technical user interface imported from the computer arts and 
not designed specifically for integrated multimedia applications. 

Prior Art multi- function remote control devices are also known 
in the art. For example a television remote control device may be 
configured to operate VCR, DVD, SurroundSound, or other devices. 
Alternately, a so-called "universal" remote control device may be 
provided to active a number of different infrared remote controlled 
consumer devices. However, in most instances, such remote controls 
must be programmed to be compatible with the make, model, and type 
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of device to be controlled, or must "learn" such control signals by 
inputting signals from the manufacturer-supplied control for such 
a device . 

Moreover, once programmed, such remote controls often require 
a two-step control function in order to operate. In order to 
control a particular device, a button must first be pressed 
indicating which device is to be controlled, and then a second 
button pressed indicating the command for the device. The 
universal remote then sends an infrared signal for the particular 
type of device selected and the command requested. The 
intelligence for such a feature resides in the remote. The 
separate consumer devices have no means by which they can determine 
context-sensitivity of a control signal. 

SUMMARY OF THE INVENTION 

A user interface provides the functionality and concurrency 
capability of a computer, without the complexities of a computer 
operating system, applications and hardware. The present invention 
permits use of a computer while maximizing a particular selected 
functionality. In particular, computer application grouping and 
launching facility on a user interface is maintained and 
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supplemented with detection of resource conflicts with an earlier 
launched application, followed by user prompt requesting choice of 
implementation of the new or preceding application. 

Since only a limited number of applications are run on the 
device, it is possible to map in advance which devices or 
applications will conflict with one another and prevent a user from 
running conflicting applications, and thus avoid cryptic error 
messages . 

Thus, for example, if a speakerphone/telephony application is 
launched and the web is already running, a prompt to select one or 
the other of the applications is produced only in the case where 
there is a resource conflict. If a DVD application is launched and 
there is input from a TV tuner, the prompt to select one or the 
other of the applications is produced only in the case where there 
is a resource conflict. Further, the user interface may be 
configured to provide enhanced hardware utilization according to a 
launched application. 

For example, when DVD is launched, a check is made to 
determine whether a TV has been connected. If a TV is connected, 
then the user interface will automatically select special hardware 
in a video-out chip to engage alternate video ports to produce a 
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better quality output. If no TV is connected when DVD has been 
launched, the user interface automatically switches back to 
standard VGA mode to enable re-display of the user interface. 

The user interface may be configured to enable user switching 
between currently operating applications and to launch new 
applications. Running applications may be selected for viewing 
with activation of a mouse button, by first activating a menu and 
then making a desired menu selection of the chosen application 
which is already running. 

When one application is running and a third party signals a 
desire to operate with a second application, the user of the first 
application may select a menu and the second application, which, if 
already loaded and running in background, is switched to the 
foreground and, if not already running, is launched. When a DVD 
application is running and a third party calls by telephone, the 
user of the DVD application may select a menu and the telephony 
application, which if already loaded and running in background is 
switched to the foreground, and, if not already running, is 
launched. 

The user interface may comprise a context manager which is 
aware of the run status of all applications and is able to 
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facilitate switching between applications. A switching sequence 
between applications may be reversible, by actuation of the menu 
and selecting the originally run application, which has either been 
terminated or is running in background. If the original 
application has been terminated, then it may be automatically re- 
launched. If the application has been running in background, it 
may be switched to foreground by menu selection. 

Particular video ports and associated operational modes 
relating to particular applications may be automatically connected 
and implemented with selection of a corresponding application on 
the menu. Particular video ports for an associated DVD movie hi- 
resolution video-out mode may be automatically switched off and 
video ports for VGA mode may be automatically connected and 
implemented with selection of a corresponding application on the 
menu. After the user has completed operation with the 

corresponding application, the menu may again be selected and the 
original application with the ancillary video-out mode may be 
reestablished to permit a user to continue watching the movie which 
was earlier playing. 

Ancillary characteristics, mappings, and modes associated with 
particular switched applications may be automatically switched and 
instituted with activation by menu of new or alternate 
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applications. Thus, a remote control working with a user interface 
permits automatic picking up of ancillary characteristics, modes, 
and mappings associated with an application. 

Particular remote functions may be mapped to associated 
application functions automatically, by menu selection of an 
application, subject to a dependency on which application is 
running in the foreground. In particular, remote control functions 
such as fast forward, stop, play, and rewind may be identified with 
corresponding application functions such as, for example, DVD or CD 
function, subject to a dependency on which application is running 
in the foreground. Further, by selection of the DVD application, 
the fast forward, stop, play, and rewind functions of the remote 
control may be mapped and applied to operate associated functions 
on a DVD player, subject to a dependency on which application is 
running in the foreground. 

Remote control commands may be dependent upon which 
application is the foreground application. The user interface may 
sense a button has been pressed such as the numeral 1, and, if a 
telephony application is the foreground application, then the 
numeral 1 is dialed. If DVD is the foreground application running, 
the first chapter of the movie may be loaded. If a CD audio player 
is playing a music disc, then the first track may loaded. In each 
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case, operation takes place automatically by the user interface 
without the user having to press a particular button on the remote 
to enable a function change. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Figure 1A is a flow chart of a remote control launch 
functional diagram according to the present invention. 

Figure IB is a flow chart of a multimedia set-top mode 
selection method in which a television (TV) mode is selected 
followed by mode status checks resulting in deactivation of any 
active digital video disk or game operations and in an interface 
style reformatting operation if the web mode is currently active. 

Figure 1C is a flow chart of a multimedia mode selection 
method in which a digital video disk (DVD) mode is selected 
followed by mode status checks resulting in deactivation of any 
active TV or game operations and in a interface style reformatting 
operation if the web mode is currently active. 

Figure ID is a flow chart of a multimedia set -top selection 
method in which a world wide web mode is selected followed by mode 
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status checks resulting in deactivation of any active digital video 
disk, TV, or game operations and in an interface style reformatting 
operation if the web mode is currently active. 

Figure IE is a flow chart of a multimedia set-top mode 
selection method in which communication mode is selected followed 
by mode status checks resulting in deactivation of any active 
digital video disk, TV, or game operations and in an interface 
style reformatting operation if the web mode is currently active. 

Figure IF is a flow chart of a multimedia mode selection 
method in which game mode is selected followed by active mode 
status checks to determine whether digital video disk or TV 
processes are active, and the showing of a games menu to permit 
selection of a particular game followed by initiation of a full 
screen game . 

Figure 1G is a flow chart of a multimedia mode selection 
method in which a PC mode is selected followed by various active 
status checks, and, if applicable, deactivation of TV, digital 
video disk, or game processes, followed by activation of a PC start 
menu . 
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Figure 1H is a flow chart of a multimedia mode selection 
method in which multimedia and audiovisual modes are separately- 
selectable . 

Figure 2A is a block diagram of a multimedia system which 
includes a set- top box, a television, speakers, input devices, and 
a coaxial cable between the television and the set -top box, capable 
of alternative audiovisual and multimedia operation subject to mode 
selection. 

Figure 2B is a diagram of an opening screen menu for a mode 
selection user interface, as it appears on a television screen to 
permit a simple presentation of user multimedia mode selection 
options . 

Figure 3 is a diagram of a digital video disk audio control 
display arrangement . 

Figure 4 is a diagram of digital video audio disk control 
display arrangement. 

Figure 5 is a diagram of telephone control display on a user 
interface . 
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Figure 6 is a schematic diagram of an arrangement of control 
fields for a remote control input device representation on a user 
interface screen. 

DETAILED DESCRIPTION OF THE INVENTION 

Figure 1A is a functional diagram of a remote control launch 
(RCL) program 1. Although discussed here in terms of a program. 
RCL program 1 may be implemented as software, hardware, firmware, 
or a combination of such elements. Thus, for example, RCL program 
1 may be implemented as a software program running within or in 
conjunction with Windows™ software. In another embodiment, an 
infrared to USB interface may be provided as a hardware /firmware 
package to capture infrared control signals from a remote control 
and convert those signals to USB commands. This USB interface may 
receive commands from an infrared remote control and convert them 
into USB command signals to control a device in the system, 
depending upon the context sensitivity of the control signal. 

RCL program 1 is an implementation of a user interface, which 
intelligently re-maps functions of a remote control based on which 
active application is operating in the foreground. Re-mapping is 
accomplished automatically without requiring a user to select a 
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desired functionality from a remote or to switch devices using 
special function keys, as is typical on universal remotes. 

In particular, once RCL program 1 has been started, a waiting 
period 2 may initiated in anticipation of a remote control button 
being pressed. Next, remote button may be pressed in step 3 by a 
user. Once RCL method 1 is implemented as a running program, all 
remote control button presses are captured. After a remote button 
has been pressed in step 3, RCL method 1 wakes up and goes through 
a number of steps to process the button message including a check 
undertaken in step 4 to determine whether an application indicated 
by the pressed button is registered with RCL program 1. 

A registered application may be defined as an application 
which RCL method 1 may determine is active or running in the 
background. Since in a set- top environment, only a limited number 
of applications may be run (e.g., telephone, DVD player, e-mail, 
web access, netradio, or the like) , it may be possible to list the 
finite number of possible applications running on the device. 

If the application has been registered, then a check is 
undertaken in step 5 to determine whether the button has been 
provided with an application specific button mapping. In order to 
use a button map, it may be necessary to know what application is 
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active and which button is pressed to determine the correct action 
list to call. 

The mapping to determine which action list to execute is as 
5 follows: (Application, Button) -> Action List. If the application 
has not been registered, then a check is undertaken in step 6 to 
determine whether the button has been provided with a default 
button mapping. If the application has no default button mapping, 
yy then control returns to wait state 2 to wait for another remote 
Q) control button to be pressed. 

fly If the application has an application specific button mapping 

f=% or default button mapping from either step 5 or step 6, the 

associated action list is performed in step 7. The action list is 
1$ a predetermined sequence of list of actions. An action is a 
^ keystroke, for example, which sends a message to a window for 

example or directing the accessing of the video ports, by way of 

another example. 

20 An action list is an ordered list of separate actions executed 

in a specific order. For each button pressed in step 3, there may 
be one or more individual actions performed. For example, when the 
PLAY button is pressed, the program may send a keystroke to the 
application to press the PLAY button. Then, the program 
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implementing RCL program 1 may send a message to the video port to 
switch display modes to interlaced video. Finally, it may send a 
message to the video port to overlay the PLAY bitmap on the screen. 
One button press causes three separate actions to be performed 
5 according to one embodiment of the present invention. Once the 
action list is completed, control returns to waiting step 2 to wait 
for a remote control button to be pressed. 



Q 

*0 The program implementing RCL program 1 may use a remote 

iS) control menu button to display the user interface. Once the user 

,_ 

interface is displayed, the user may launch any registered 
flj application, return to a running registered application, or switch 
£3 to any running application by using the remote control. The user 

ru" 

q interface is generally displayed unless the user selects the PC 
£5 button which hides the custom user interface and thereupon displays 
a standard Windows™ desktop. 



Figure IB is a flow chart of a multimedia mode method 9 in 
which an active television mode may be selected, followed by 
20 various active status checks. If digital video disk or game 
processes are active, these process modes may be halted, (e.g., 
paused and minimized) . The TV image may be further subordinated 
within a web browser framework if the web mode is currently active. 
Predetermined TV functions may be displayed in a remote control 
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analogy to enable direct user implementation of volume and channel 
changes with a control window expressing choices of configuration, 
color, and window size. 

In particular, according to multimedia mode method 9, a user 
may press, in step 10, TV mode button or menu using a remote 
control (RC) input device to set-top box of a television connected 
to the set-top box. Alternatively, a user may click on a TV field 
in a main menu of a user interface in which an emulation of a 
remote control input device may be presented on the TV screen. 
Next, a check may be made in step 11 to determine whether a digital 
video disk (DVD) player connected to the set-top box is active, or 
whether a game mode is active in the multimedia, system. If a game 
or DVD operation is underway, the associated movie or game may be 
recognized as being active and may be paused and minimized in step 
12 on the interface display, causing operations to halt. 

Next, a check may be made in step 13 as to whether internet 
communications are currently active. If such a communication is 
underway, a TV image representation may be produced in step 14 in 
a window of predetermined size within a web browser representation 
on the TV screen. If the web mode is not currently active, 
presentation of a full screen TV image may be initiated in step 15 
without browser subordination. In such a TV mode of operation, 
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conventional TV functions may be used in step 16 with a remote 
control (RC) input device or its screen emulation to change 
channels or volume. 

For example, the TV display may bring up a TV control window 
having configuration, color, and window size control fields which 
may be mouse or keyboard selected. A mouse image control field may 
be produced in the TV control window which includes a left mouse 
button field on which a cursor indicated click will produce video 
window toggling between full screen and windowed modes. 

Figure 1C is a flow chart of a multimedia mode method 19 in 
which digital video disk mode is selected followed by various 
active status modes checks. If applicable, deactivation of TV or 
game processes follows, including subordination of DVD images 
within a web frame work if the web is active. DVD functions may be 
displayed in emulation of a remote control to implement play, skip, 
and pause activities in a similar manner as is presented on a DVD 
player control panel. 

In step 20, a user may press the digital disk (DVD) button on 
a remote control (RC) input device. Alternatively, the user clicks 
on the DVD field in a main menu of a user interface. Next, a check 
is made in step 21 to determine whether a TV or a game mode is 
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active on the multimedia system. If TV operation or a game is 
currently underway, the TV program or game may be paused and 
minimized (e.g., halted) on the interface display in step 22. 
Next, a check is made in step 23 as to whether internet 
communications are currently active. If such communication is 
underway, a DVD image representation may be made in a window within 
a web browser representation may be initiated in step 24 on the TV 
display. 

If the TV mode is currently active, particular TV channels may 
be selectable on a presented control image having channel up and 
down keys and pound (#) keys. Forward and reverse keys may be 
activated on a DVD controller image to move backward and forward 
through a DVD program as illustrated in step 26. A mouse image may 
be use to navigate over control images and to select play and 
disconnect options. A remote control display image brings up web 
size option fields including full screen, background, and ticker 
format options. Upon detection of incoming mail, a mail icon may 
pop up on the screen. Clicking on the icon or pressing the web 
field will cause received mail to pop up. Clicking on the right 
mouse button removes the mail icon produced in a window within the 
web browser representation on the TV screen. 
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If the web is not currently active, a full screen DVD image 
may be initiated in step 25 on the TV display. In this DVD mode of 
operation, the external remote control image device or its screen 
image representation with associated active fields on a DVD player 
5 control panel permits actuation of play, skip, and pause functions 
to be actuated, as illustrated in step 26. A mouse image control 
field may be produced in the TV control window which represents a 
left mouse button field on which a cursor indicated check will 

o 

cause video window toggling between full screen and windowed modes. 

Jfc 

45 Figure ID is a flow chart of multimedia mode method 29 in 

|y which world wide web mode may be selected, followed by various 

£3 status checks and, if applicable, deactivation of communication 

fij 

q functions including telephone and facsimile transmission, and 

%J 

3f5 subordination of an TV, DVD, or game images in a window surrounded 
^ by web, wherein TV channels, game commands and activities, and DVD 
settings are intuitively controllable, web size options are 
settable and mail delivered over the web may be detected and 
announced with appearance of a removable mail icon. 

20 

In step 30, a user may press a world wide web button on a 
remote control (RC) input device to a set-top box of a television 
connected to the set-top box, or click on the world wide web field 
in a main menu of a user interface. Next, a check is made in step 
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Atty. Docket No 0908-CE 



PATENT 



31 to determine whether a communication mode may be active on the 
multimedia system. If the communication mode is active, telephone 
and facsimile operation may be terminated in step 32. 

Next, a check is made in step 33 to determine whether a TV, 
DVD, or game mode may be active. If any such a mode is found to 
active, the particular mode visual representation may be produced 
in a window within a web browser representation on the TV screen. 
If no such a mode is active, a full screen web browser 
representation may be initiated in step 35 on the TV display. 

In step 36, if the TV mode is active, particular TV channels 
may be selectable on a presented control image having channel up 
and down keys and pound (#) keys. Forward and reverse keys may be 
actuated on a DVD controller image to move backward and forward. 
A mouse image may be used to navigate over control images and to 
select play and disconnect options. A remote control display image 
brings up web site option fields including full screen, background, 
and ticker format options. Upon detection of incoming mail, a mail 
icon may pop up on the screen. Clicking on the icon or pressing 
the web field will cause received mail to pop up. Clicking on the 
right mouse button may remove the mail icon. 
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Figure IE is a flow chart of multimedia mode method 3 9 in 
which communication mode is selected, followed by various active 
status checks and, if applicable, deactivation of the web. If a 
TV, DVD, or a game mode is active, the associated image or images 
5 may be placed in a window having an associated communication 
control panel, enabling caller ID, call answering, and related 
function activation by the user. In step 40, a user may press a 
^ communication button on a remote control (RC) input device to a 
^ set-top box of a television connected to the set-top box, or click 
5p on the communication field in a main menu of a user interface. 

W A check is made in step 41 whether a web mode is active on the 

C3 multimedia system. If the web mode is active, it is disconnected 
Q from service in step 42 and the web browser representation is 
3.15 minimized. Next, a check is made in step 43 whether a TV, DVD, or 
game mode is active. If any such mode is found to be active, the 
particular associated mode visual representation is produced in a 
window representation 'on the TV screen in step 44, with a 
communication control expressed at the bottom of each such 
20 particular window. If no such a mode is active, a lower screen 
communication application representation is started in step 45. 

Such a representation includes fields expressing predetermined 
telephone functions on a remote control as illustrated in step 46. 
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An incoming call during activation of the COM mode causes a called 
ID window to pop up in the lower right hand corner of the screen on 
top of any other active applicants including TV, DVD or game mode 
displays. Pushing the COM button on a remote control input device 
5 or clicking on the caller ID window of the remote control 
representation image may result in the incoming call being 
answered, causing any DVD movie or game operation to pause, or 
lowering TV volume while popping up the COM controller panel and 

f 

y3 volume mixer images. The right mouse button, when clicked may 

=|~ 

W cause a caller ID message indicator to be turned off. 

fy Figure IF is a flow chart of a multimedia mode method 4 9 in 

O which a game mode is selected followed by various active status 
Q checks, and if applicable, deactivation of digital video disk or TV 
lfS process modes and the showing of games menu to permit selection of 
^ a particular game followed by initiation of a full screen game. In 
step 50, a user may press a games button on a remote control (RC) 
input device to a set-top box of a television connected to the set- 
top box, or clicks on the games field in a main menu of a user 
20 interface. In response, the games menu may be shown in step 51 and 
the user may then select a particular game. 

Next, a check is made in step 53 whether the TV or the DVD 
mode is active. If either such mode is active, the particular 
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activity is paused and minimized in step 54. If neither mode is 
active, a full screen game image may be presented on the TV screen 
in step 55. 

Figure 1G is a flow chart of a multimedia mode method 59 in 
which a personal computer (PC) mode may be selected followed by 
various active status mode checks and, if applicable, deactivation 
of TV, digital video disk, or games processes, followed by 
activation of a PC start menu. In step 60, a user may press a 
personal computer (PC) button on a remote control (RC) input device 
to a set-top box of a television connected to the set-top box, or 
clicks on the PC field in a main menu of a user interface. 

Next, a check is made in step 61 whether a TV, DVD, or game 
mode is active. If such a particular mode activity is found to be 
active, the particular identified activities may be stopped or 
paused in step 62. If no such activity is identified as active, 
the start menu may be activated in step 63. Thereafter, operation 
is ended in step 64. 

Figure 1H is a flow chart of a method 69 in which multimedia 
and audiovisual modes are selectable. In step 70, a user may press 
a multimedia audio visual (MM/AV) button to permit predetermined 
control of selected multimedia equipment. Clicking the button in 



Atty. Docket No 0908-CE 



PATENT 



step 71 may cause the letters AV to be displayed on the monitor, so 
the user will identify the current mode of operation. Clicking 
again will put the remote in control of predetermined PC multimedia 
functions . 

Figure 2A is a block diagram of a multimedia system 8 0 having 
set-top box 81, television 82, speaker or speakers 83, input 
devices 84, and coaxial cable 96 or other link between television 
82 and set- top box 81, capable of alternative audiovisual and 
multimedia operation subject to mode selection methods. Set-top 
box 81 may include bus 95 which interconnects RAM 86, ROM 87, modem 
88, processor 89, input device interface 90, video card 91, TV 
tuner 92, DVD/CD player 93, mass storage 85 (e.g., hard drive) and 
sound card 94. Video card 91 and TV tuner 92 may be connected by 
coaxial cable 92 with a video input port of television 82. Sound 
card 94 may be connected to an audio input port of television 82. 

As discussed above, input devices 84 may include remote 
control devices such as a TV type remote control device and may 
typically be of the infrared or RF type remote control type. Input 
device interface 90 may comprise a infrared to USB signal 
converter. Input device interface 90 may receive remote control 
signals, and, depending upon context of use (as previously 
discussed) convert these signals to USB signals for controlling a 
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particular device. Thus, an infrared signal for the numeral "2" 
would remain the same regardless of whether such a signal was 
intended to change a television channel, select DVD track, dial a 
phone number, or type the number "2" in an e-mail message. Input 
device interface 90 (and/or software relating thereto) may receive 
such a signal, and, cognizant of the context of the signal (i.e., 
which application is running in the foreground) generate the 
appropriate USB signal to control or communicate with the 
appropriate device in the system. 

Note also that bus 95 may represent one or more physical 
busses within set-top box 81. Set-top box 81 may include, for 
example, a universal serial bus (USB) for communicating between 
peripheral devices. Other system buses (e.g., P-bus, ISA bus, or 
the like) may interface with the USB and processor 8 9 and other 
system resources (e.g., RAM 86 and ROM 87) . Such a bus structure 
is known in the computer art and may be applied here without 
departing from the spirit and scope of the present invention. 

One or more input devices 84, including but not limited to, a 
keyboard, mouse, or remote control input device, may be coupled 
hard-wired or wireless signal communication with input device 
interface 90. Modem 88 may connect set-top box 80 to the Internet 
and World Wide Web 97. 
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Processor 89 may comprise, for example, a Pentium™ class 
processor manufactured by Intel Corporation. Construction of such 
a Pentium™ class PC architecture is known to those of ordinary 
skill in the art. In order to reduce cost for the consumer market, 
however, many "legacy" features and connectors of a traditional PC 
may not be implemented in set -top box 81 of Figure 2A. Moreover, 
the overall appearance and configuration of the set-top box 81 may 
be more akin to a consumer electronic device (e.g., VCR, DVD 
player) than a personal computer. 

Figure 2B is an opening screen main menu user interface 94 
which may appears on the television screen to permit simple non- 
Window presentation of user mode selection options. In particular, 
main menu 99 shows button or actuation fields for selection of 
operational modes: TV 100, DVD 101, world wide web (WWW) 102, games 
103, communication 104, PC operation, and multimedia or audiovisual 
modes 106. By positioning the cursor over the particular desired 
button and making a mouse click or double-click, or by actuating 
the desired button with another input device such as a remote 
control, a desired multimedia mode may be selected. 

Figure 3 is a digital video audio control display a for a user 
interface. In particular, the display shows a window including 
audio mixer control fields 109, DVD control fields 110, a DVD/CD 
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selection field 111, and a plurality of other predetermined mode 
specific control fields 120-124. Control fields 120 permit 
selection of DVD content, and control fields 121 permit selection 
of CD content . 

Audio mixer 109 may have a telephone volume setting system 
130, game volume setting system 131, and web volume setting system 
132. Telephone volume may be settable along control bar 140. . Game 
volume may settable along control bar 141. Web volume may be 
settable along control bar 160. DVD and CD settings include rewind 
170, play 171, pause 172, exit 173, fast forward 174, and volume 
176 . 

Figure 4 is a digital video audio control display for a user 
interface. In particular, the display shows a window including 
audio mixer control fields 109 and DVD control fields 110. Audio 
mixer 109 may have telephone volume setting system 130, game volume 
setting system 131, and web volume setting system 132. Telephone 
volume may be settable along control bar 14 0. Game volume may be 
settable along control bar 141. Web volume may be settable along 
control bar 160. DVD and CD settings include rewind 170, play 171, 
pause 172, exit 173, fast forward 174, and volume 176. 
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Figure 5 is a telephone control display for a user interface. 
In particular, the display shows a window including audio mixer 
control fields 109 and telephone control fields 113 including an 
answer button 114, number buttons 115, volume setting buttons 116, 
5 dial button 117, address button 118, and caller ID button 119. 
Using the remote control, a user may use the set-top box 81 to make 
and receive telephone calls, either through ordinary phone 
connections, or through the internet and the like. 

li> Figure 6 is a schematic diagram of an arrangement of control 

j£ fields for a remote control input device or an emulation 

fy representation 198 thereof. The control input device 

g representation 198 includes a window 210 including predetermined 

if* jj 1 

fH control fields 200, mouse buttons 201, number character fields 202, 
lM and volume and channel control keys 203. Control keys 200 include 
buttons for actuating power, selection of MM/AV modes, games, PC, 
TV, DVD, VCR, world wide web, menu selection, and communication 
activities. Channel keys 203 include selection buttons for volume 
and channel navigation as well as fast reverse 180, play 181, stop 
20 182, fast forward 184, and pause 186. 

User interfaces are not new to computers and even in some 
cases to consumer devices. The objective of the user interface of 
the present invention is to offer the functionality, and 
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concurrency capability of a computer while hiding the complexities 
of the operating system, applications and of the hardware. 

The user interface of the present invention does much more 
than enable a user to select which tasks to run and see if there is 
a conflict. It enables a user to use the computer while maximizing 
the intended functionality. 

For example, in a typical Windows environment, the user interface 
enables applications to be grouped and launched just like the user 
interface of the present invention. However, the user interface 
(UI) of the present invention also performs the following tasks. 
Once an application is launched, the UI detects if the application 
has a resource conflict with another application and then either 
prompts the user for a choice to kill the first application or the 
new application. It does this in case of launching a 

speakerphone/ telephony application if the WEB is already running, 
and only in the case where there is a resource conflict. The same 
is true for watching DVD or input from a TV Tuner. 

The present invention may also enable better use of the 
hardware based on the application being launched. For example, 
when launching DVD, the UI will automatically switch video ports to 
give a better quality output to a TV by leveraging some special 
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hardware in the video out chip and only if a user is connected to 
a TV. If the user is not connected to a TV, the UI, it would not 
do this. Once the application is stopped, the user interface 
automatically switches back to the standard VGA mode to enable the 
UI to be displayed again. 

Additionally, the UI is used to switch back and forth between 
applications which are either running or to launch new 
applications. In a Windows environment, a user may launch 
applications by selecting the application through the start menu. 
A user may also check to see which applications are running by 
hitting CTRL-ESC. Then the user may switch to one of the running 
applications by holding down the alt key and continuously hitting 
the tab key to cycle through the applications. However, all of 
these require separate multiple keys to perform or require a 
keyboard. This is possible to do with just a mouse. 

In the UI of the present invention, is a user wants to watch 
a DVD movie and then a call comes in, the user may hit the menu key 
to go to the UI, then select the telephony application. If the 
application is already loaded and running in the background, the UI 
knows this and becomes a context manager to switch applications. 
If the application is not loaded, it launches the application in 
time to answer the call. Then the user may then use the Menu key 
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to go back to watching the movie. If the user happens to be 
watching the movie in the special DVD movie hi -res mode only, it 
also switches video ports to enable the menu to be displayed in VGA 
mode and then switch back to Video out mode to watch the movie. 

Finally, one important feature of the UI of the present 
invention is the ability f or the remote to pick up the 
characteristics of the application which is running via the UI . 
For example, on a typical universal remote control, if a user 
presses the DVD buttons, then the remote's fast forward, stop, 
play, rewind buttons are mapped to the DVD player. The user 
switches to CD by pressing the CD button, and then the buttons are 
mapped to a particular device. 

In the present invention, the remote control commands are 
dependent on which application is the foreground application 
running. The UI senses a button has been pressed such as the 
number 1, and if a telephony application is the foreground 
application, then the number 1 is dialed. If DVD is the foreground 
application running, then the 1st chapter of the movie is loaded. 
If the CD-Audio player is playing a music disc, then the first 
track is loaded. All this is automatically handled by the UI 
without having the user have to press a particular button on the 
remote to enable a function change. 
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RC Launch is a user interface which intelligently re-maps the 
function of the remote control based on the active application. 
This re-mapping occurs automatically without requiring the user to 
select a desired functionality from the remote or to switch devices 
using special function keys as is typical on universal remotes. 

Once RC Launch is running, all remote control button presses 
are captured. When a RC Launch button press occur, the program 
"wakes up" and goes through the following steps to process the 
button message. First, it checks if the application is registered 
by RC Launch. If it is, it checks if there is any application 
specific mappings for this button. If there are it executes the 
action list. Otherwise, it checks if there is any default button 
mappings. If there is, then it executes the action list. If there 
is not, it returns to the "waiting for button press" state. 

RC Launch also uses a remote control menu button to display 
the user interface. Once the user interface is displayed, the user 
may launch any registered application, return to any running 
registered application, or switch to any running application by 
using the remote control. Normally, the user interface will always 
be displayed unless the user selects the PC button which will hide 
the custom user interface. Thus, the system will display the 
standard Windows desktop. 
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While the preferred embodiment and various alternative 
embodiments of the invention have been disclosed and described in 
detail herein, it may be apparent to those skilled in the art that 
various changes in form and detail may be made therein without 
departing from the spirit and scope thereof. 



